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Abstract 

A traffic flow is one of the main transportation issues in nowadays 
industrialized agglomerations. Configuration of traffic lights is among the 
key aspects in traffic flow management. This paper proposes an evolution- 
ary optimization tool that utilizes multiagent simulator in order to obtain 
accurate model. Even though more detailed studies are still necessary, a 
preliminary research gives an expectation for promising results. 

1 Traffic flow management 

Early models of traffic flow (called macroscope models) treated vehicles in the 
collective manner basing on the analogy to particles in a fluid [7] . Later on, more 
precise (mezoscope) models were being created consecutively (mostly based on 
gas kinetics) [5]. Currently, a multiagent simulation mechanism provides much 
more efficient microscope model where each vehicle can be regarded separately 
allowing for highly detailed analysis including collision avoidance pQ, traffic 
virtualization [2J, interactions with pedestrians [3], etc. 

Traffic flow management varies from tracing main roads average capacity 
across certain area (where macroscope models give satisfactory results) to very 
low-level manipulations including re-arrangement of lanes, modifying traffic 
lights configuration, planning bridge locations, etc. where microscope models 
are most suitable [S]. 



2 Multiagent traffic flow simulator 

The agent-based traffic flow simulator described in [S] is the universal microscope 
model. The environment for agents in this model comprises of a system of city 
streets defined in XML files using the following entities illustrated in Figure Q] 
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Figure 1: Elements of environment description presented on the part of a sample 
junction. 



• road - defines the one-way part of a street, i.e. an existing path leading 
from one junction to another. For the sake of simplicity, roads at the 
frontiers of a model are considered dead-end even though they play roles 
of ingoing or outgoing roads. 

• queue - defines a single lane represented as a first-in-first-out list of ve- 
hicles located on this lane one after another. Note that there has to be at 
least one queue for each road at each junction. 

• trajectory - corresponds to a trajectory of vehicles crossing the junction 
from a given ingoing road to a given outgoing road. Each trajectory stores 
the information about other trajectories with possibile collisions with it. 

• track - an abstract pair queue-trajectory binding three entities, namely 
queue at ingoing road, queue at outgoing road and trajectory from one to 
another. 

Each vehicle in the environment is an agent that is aware of its current 
speed and exact location within a model (particularly, its relative position on 
the present road) . What is more, a vehicle is assigned another agent who drives 
it in order to achive the driver's own aim which is to get from point A to point 
B chosing the best possible way. 

Driver agents are equipped with a simple perception mechanism that allows 
them to acquire information about a vehicle driven by them (e.g. current lane, 
driving speed or acceleration) and the current state of environment in their 
proximity, particularly: other vehicles (their behaviour, distance to them, etc.) 
and traffic lights. 

For the sake of efficiency, described model includes the following simplifica- 
tions that should be taken into account: there are traffic lights at each junction, 
there arc no roundabouts and the presence of pedestrians is ignored. 
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Simulation process in described model is the sequence of N 6 N iterations 
executed every r > miliseconds (by default iV = 1000 and t = 200). Each 
iteration includes the following operations: 

1. Apply changes in the environment (if there are any at this time period) 
including the presence of colliding tracks and the state of traffic lights. 

2. Refresh all agents' local information about the state of environment. 

3. Refresh locations of all moving vehicles according to intentions of their 
drivers considering current speed and acceleration of vehicles. 

4. Remove agents that achived their aims and create new ones if possible. 

Vehicle agents collect some essential information during simulation, i.e. exact 
trace; number, locations and durations of stops; average speed etc. for the sake 
of further analysis. 

Figure [3] depicts arrangement of main streets in Wroclaw, Poland that can 
be easily modelled using described agent-based simulator. 

3 Optimization of traffic lights 

Traffic lights are commonly used as an effective solution for car flow routine 
regulation in virtually all agglomerations. Modification of traffic lights configu- 
ration is the key aspect in optimization of traffic flow for the model presented 
in the previous section. 

In many real-world situations, traffic lights configuration settings are based 
on combination of averaged theoretical data and designer's assumptions. A 
multiagent simulation approach can be used instead in order to provide more 
accurate data. 

A cyclic sequence of consecutive changes of lights including detailed informa- 
tion about duration of time when each light is on combined with dependencies 
amongst all traffic lights within a given area (typically a crossroad) is referred 
to as traffic lights programme. The usual representation of such programme is 
a graphical timeline presented in Figure [5] 




Figure 2: A sample junction with two pairs of traffic lights (left) and a corre- 
sponding traffic lights programme (right). 
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Figure 3: Arrangement of main streets in Wroclaw (Poland) that can be easily 
modelled with the agent-based simulator. 

The merit of underlying optimization process lies in realistic accuracy pro- 
vided by the agent-based simulator. Performance of contemporary hardware is 
sufficiently enough for launching simulations containing even millions of agents 
in place of less accurate statistical estimations that were used in previous years. 
Thus, the values of a function that is being optimized are in fact results of 
agent-based simulation. 

3.1 Constraints 

Any traffic lights programme is obliged to satisfy the following constraints: 

• A change of lights cannot violate the sequence (green, yellow, red, red+yellow) 
repeated continuously. 

• Duration of green light must be greater or equal to a given minimal time 
length whereas durations of transient lights (i.e. yellow and red+yellow) 
are constant and cannot undergo any optimization. 

• No collision possibilities are allowed, i.e. red light must be lit on at one 
pair of traffic lights until green light turns to yellow on another pair and 
remains yellow for a given time period; similar condition must be satisfied 
during a change from green to red light. 

3.2 Criteria 

The aim is to optimize a traffic lights programme by maximizing a car flow 
subject to constraints described above. Typical optimization criteria in such 
case would be: maximizing the number of agents that achived their aims during 
simulation, minimizing the average time of a ride, maximizing average speed of 
vehicles, etc. Since most of the criteria correspond to each other an aggregation 
of at least two of them provides a fair evaluation function. 
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Figure 4: A sample programme of z-th traffic lights represented in binary chro- 
mosome form (up) and its corresponding timeline form (down). 
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3.3 Representation 

Assume that T > is a time length of one traffic lights cycle at a junction. Time 
range [0,T] can be discretized into T/t intervals of r > miliseconds each as it 
was mentioned in the previous section. Let t m i„ be the minimal and 

T 

tmax = k ■ t m i n — C, (C = const) (f ) 

r 

be the maximal feasible time length of green light duration. Note that t max is 
determined by the time length of green light duration for k tracks colliding with 
current track and some constant value reserved for transient lights. 

As a result, any programme of M > traffic lights can be well-defined by 
the set of pairs 

{(storti,ti), (start 2l t 2 ), . . . , (start M ,t M )}, (2) 

where starti represents the number of time interval when i-th traffic light turns 
to green and remains for the next U time intervals (i = 1, . . . , M). Duration of 
red light can be computed therefore as T — ti — C. 

Evolutionary algorithms provide an efficient optimization mechanism for the 
problem presented above. Let n > be the lowest integer value that satisfies 
condition T/t < 2™, hence 

^ tmin — tmax ^ 2 . (3) 

Any traffic lights programme expressed in the form ([2]) can be encoded as a 
2M7V-element binary chromosome containing M pairs of TV-bit values (Li,Ri) 
such that 

starti = Li mod T/t, (4) 

t{ tmin ~1~ [Ri mod (t max t m i n 

+ 1)] (5) 
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for i = l,...,M. 



3.4 Algorithm 

Population-Based Incremental Learning (PBIL) [I] can be used as an evolu- 
tionary optimization tool for the stated problem thanks to its simplicity and 
promising results in a broad range of applications. It is also worth noticing 
that even more complex evolutionary algorithms could be applied instead with- 
out a significant decrease of performance due to considerably time consuming 
evaluation process that is suggested in this paper. 

Algorithm [T] presents the pseudocode of PBIL. It is so called Estimation of 
Distribution Algorithm (EDA) [6] based on the idea of optimizing a probability 
model for solution rather than implicit set of solutions. Later on, individuals 
are randomly generated according to obtained probability distribution. 

The requirement for collision avoidance is not satisfied by the traffic lights 
programme definition itself, hence the presence of infeasible individuals in popu- 
lation might be expected. Figure [5] presents a simple conflicts resolving method 
for this case. If a collision possibility occurres between a pair of trajectories 
then corresponding traffic lights programme can be modified in order to ensure 
arbitrary set C distance between green light durations. If any of modified green 
light durations becomes shorter than t m j n then it is automaticaly expanded to 
t m i n in the only possible way. Finally, if a conflict still occurres, a new random 
individual is selected. 



Algorithm 1 Standard PBIL algorithm with parameters < 9\ , 02 , 83 < 1 on a 
population of size individuals each of which is represented as d-element binary 

vector. 

p <— InitialProbabilityVectorQ 
P <— RandomPopulation(p, size) 
PopulationEvaluation(P) 
while not TerminationCondition(P) do 
Xi Bcstlndividual(P) 
for k <— I to d do 

Pk <- Pk ■ (1 - #1 ) + x lk ■ 6 X 
end for 

for k <— 1 to d do 

if UniformRandom(0, I) j 82 then 

Pk <— Pk ■ (1 — #3) + BinaryRandom(0.5) • 63 
end if 
end for 

P RandomPopulation(p, size) 
PopulationEvaluation(P) 
end while 
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4 Conclusions and Perspectives 



Even though the results are partial at the moment and more detailed studies 
are still necessary, a preliminary research gives an expectation for promising 
results. An improvement of agent-based traffic flow model could be a next step. 
Also a modification of evolutionary mechanism may improve the performance of 
optimization process. Replacing PBIL with Bayesian Optimization Algorithm 
(BOA) [5] could ensure obtaining much more detailed model. Unlike other 
evolutionary algorithms, BOA not only searches for optimal solution but also 
gives some information about its structure. Lots of dependencies (e.g. among 
traffic lanes and even adjacent junctions) could be modelled in terms of Bayesian 
networks that are utilized in BOA. What is more, such dependency model could 
include the fact that more effort should be put to traffic flow management inside 
city centers than suburbs because of greater amount of junctions, narrow and/or 
one-way street, etc. 

As it is clearly seen, the effectiveness of agent-based approach applied for 
traffic flow managements provides a broad range of ideas. 
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Figure 5: Simple conflicts resolving method. 
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